Unsupervised Video Summarization Based on An Encoder-Decoder Architecture
نویسندگان
چکیده
Abstract The purpose of video summarization is to facilitate large-scale browsing. Video a short and concise synopsis original video. It usually composed set representative frames from the This paper solves problem unsupervised by developing Summarization Network (VSN) summarize videos, which formulated as selecting sparse subset that best represents input VSN predicts probability for each frame, indicates possibility frame being selected, then takes actions select according distribution form summary. We designed novel loss function into account diversity representativeness generated without labels or user interaction.
منابع مشابه
Video Summarization with Attention-Based Encoder-Decoder Networks
This paper addresses the problem of supervised video summarization by formulating it as a sequence-to-sequence learning problem, where the input is a sequence of original video frames, the output is a keyshot sequence. Our key idea is to learn a deep summarization network with attention mechanism to mimic the way of selecting the keyshots of human. To this end, we propose a novel video summariz...
متن کاملUnsupervised Object-Level Video Summarization with Online Motion Auto-Encoder
Unsupervised video summarization plays an important role on digesting, browsing, and searching the ever-growing videos everyday. Despite the great progress achieved by prior works (e.g., the frame-level video summarization), the underlying fine-grained semantic and motion information (i.e., objects of interest and their key motions) in online videos has been barely touched, which is more essent...
متن کاملInteractive Encoder-Decoder System for Video
By using hierarchical table-lookup vector quantization (HTVQ) to quantize the large dimensional input vectors successively in stages, combined with any convenient VQ design algorithm for the last stage quantization , the encoder-decoder system can be designed symmetrically, implemented mainly by table-lookups, no extra arithmetic computation, which is amenable to efficient software and hardware...
متن کاملA Correlational Encoder Decoder Architecture for Pivot Based Sequence Generation
Interlingua based Machine Translation (MT) aims to encode multiple languages into a common linguistic representation and then decode sentences in multiple target languages from this representation. In this work we explore this idea in the context of neural encoder decoder architectures, albeit on a smaller scale and without MT as the end goal. Specifically, we consider the case of three languag...
متن کاملDecoupling Encoder and Decoder Networks for Abstractive Document Summarization
Abstractive document summarization seeks to automatically generate a summary for a document, based on some abstract “understanding” of the original document. State-of-the-art techniques traditionally use attentive encoder–decoder architectures. However, due to the large number of parameters in these models, they require large training datasets and long training times. In this paper, we propose ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of physics
سال: 2022
ISSN: ['0022-3700', '1747-3721', '0368-3508', '1747-3713']
DOI: https://doi.org/10.1088/1742-6596/2258/1/012067